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Executive Summary 

The legal definition of Florida’s public education system includes its local public 
schools, charter schools, voucher schools, and schools contracted to provide special- 
education services. The constitutional mandate for a “uniform, efficient, safe, secure, and 
high-quality system of free public schools” suggests that the expectations of a high- 
quality education should be the same for all schools receiving aid from the state. 
Considering the recent controversy over the accountability of private schools given 
public funding — the voucher schools in the state’s four voucher programs — a scrutiny of 
Florida’s accountability system is timely. This review includes a comparison to the 
constitutional mandate and a description of how it applies to the different schools 
receiving direct and indirect aid from state policy. 

This brief explains why accountability is a common public expectation today; it 
describes what is new in Florida’s accountability policies since 1999; and it compares 
those policies to the national mandates in the No Child Left Behind Act. The explicit 
value of Florida policies is described here; the state Department of Education’s 
implementation of the accountability policies is explicated, as is the applicability of the 
policies to different types of schools receiving direct and indirect aid from the state. The 
brief finds both benefits and areas of concern in the current accountability policy, when it 
is looked at as a set of structures. 
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Benefits 



1. Florida policy sets positive expectations for children. Florida’s official 
assessment and accountability policies affirm children’s rights to a high- 
quality education. 

2. Florida’s accountability policy is an extension of adult experiences in 
education. Florida’s official assessment and accountability policies dovetail 
with the experiences of adults in the state. 

3. Florida has had a practical testing program since before 1999. The original 
(1995 and 1996) design of the FCAT would have allowed it to be a reliable 
guide to student achievement over the years — had it not been used as a basis 
for so many consequences. 

Areas of Concern 

1 . Florida does not hold all publicly-aided schools to the same standards. 
Because all schools receiving financial aid are part of the “free public 
education” system under Florida’s constitution, the existence of different rules 
for different types of schools constrains parents, and the state from making 
accurate and fair comparisons among tax-supported schools in Florida. 

2. Florida has frequently-changing and obscure accountability rules. The 
standards for grading Florida’s local public and charter schools have changed 
frequently and are not clear, or easily understandable, to either educators or 
the general public. 



Executive Summary 9.2 




4. Florida relies on one set of measures for all accountability consequences. 
Florida’s accountability system relies on a snapshot of student performance 
for multiple purposes. 

5. Florida keeps test items secret after the end of testing each year. Test security 
must be balanced against the need for transparency so that the public can 
ensure that tests, especially those carrying high stakes, are accurately scored — 
and that they validly measure what they purport to measure. 

Recommendations 

1 . Create a uniform system of accountability that allows the accurate assessment 
of, and comparison among, all schools receiving direct or indirect financial 
aid from the state. 

2. Redesign Florida’s accountability regime so that the FCAT and other test 
results are used in a professionally-validated manner as described in the 
Standards for Educational and Psychological Testing, published jointly by the 
American Educational Research Association, the American Psychological 
Association, and the National Council on Measurement in Education. 

3. Release the test items on the FCAT test each year for public review (and 
comment). 
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Reforming the Structure of Florida’s Accountability System 



Sherman Dorn 

University of South Florida 

Section 1: The Issue 

This brief discusses the application of Florida’s accountability policies to all 
schools given direct and indirect aid by state policy. It analyzes the structure of written 
policies and compares existing policies to the constitutional requirement that Florida’s 
state government provide a “uniform, efficient, ...high-quality,” free public education 
system. 1 The focus of this paper is the comparison of accountability provisions among 
different types of schools receiving financial aid from state policies. This brief does not 
analyze the voucher program tied to local public school accountability, though it does 
discuss differences in accountability policies as applied to different schools given 
financial aid by the state. Nor does this brief discuss the effects of the accountability 
system on classroom teaching or compare the third-grade retention policy with the 
research base. 

A few definitions are in order, first. Assessment refers to any collection of 
information on student performance or skills. While the most commonly known 
assessments are annual standardized tests, there are many types of useful assessments in 
schools. Accountability refers to any method of comparing what happens in schools to 
the accepted obligations of schools. Accountability can include the results of annual 
standardized tests, but it also refers to schools’ responsibilities to be financially prudent, 
to look after the safety of students, and to be part of a democratic society. 
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The public education system, as outlined in the Florida state constitution, legally 
includes private schools that accept direct or indirect aid from the public. In Bush v. 
Holmes, Florida’s First District Court of Appeals ruled that the constitutional requirement 
for “free public education” did not prohibit aid to private schools. The court ruled that 
the state could fulfill its obligation to the public through a system that included payments 
to private schools. Because the courts interpret the state constitution in this way, this 
brief treats all schools receiving direct or indirect aid from the state as part of the public 
education system in Florida. 

The following terms refer to the different schools receiving financial aid from 
state policies: local public schools, charter schools, voucher schools, and contract 
schools. The vast majority of facilities are local public schools — county school boards 
oversee them and they rely on local property taxes, state aid, and federal grants to 
operate. Charter schools are schools that non-profit organizations run with public 
funding, though the operation of some charter schools in Florida has been contracted out 
to private “educational management organizations.” Charter schools operate under multi- 
year contracts with county boards of educations. Voucher schools accept direct or 
indirect state aid under one of the four voucher programs in Florida: the Opportunity 
Scholarship Program (also known as the failing-schools voucher), the McKay 
Scholarship voucher program for students with disabilities, the corporate tax-credit 
voucher program, and the K-8 virtual-school voucher program. Contract schools accept 
individual students with disabilities through funding from a local public school — in rare 
cases — such as when a county cannot provide an appropriate education for individual 

•5 

students with very unusual needs. 
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Section 2: Background 



Why Accountability 

There is broad agreement that public education should be accountable. There are 
a number of reasons for this consensus. A school is one of the local faces of government, 
and while Americans are willing to spend large sums on education, they want to be sure 
that schools fulfill their obligations. 

Education is a much bigger political issue, at both the state level and at the 
national level, than it was before World War II, and the last three presidents have all 
claimed to be “education presidents.” States and the federal government have funded a 
much greater share of elementary and secondary education in the last forty years than at 
any other time in the nation’s history. In return, legislators and policymakers want some 
control over what schools do with the money. 

As state and federal politicians have paid more attention to education, they have 
called on schools to help fight various enemies. Federal legislation since the 1950s has 
called on schools to help win the Cold War, to fight the War on Poverty, to battle racism, 
and to provide American companies with a well-educated workforce capable of 
competing in the world economy. Each of these “calls to action” for schools has built 
more pressure to make schools perform. 4 

In light of the history of education since World War II, it would be difficult to 
feign surprise at the call for accountability in education. However, Florida’s current 
accountability system is not the only model available. Accountability has not always 
been thought of as tax money given, or withheld, on the basis of test scores. 
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Assessment and Accountability in Florida 



Florida’s local public schools operate under strict accountability systems. State 
laws and regulations detennine how local public schools can spend money, whom local 
public schools may hire, and what local public schools can teach. In addition, the state 
government requires annual standardized testing of all third- through tenth-grade students 
in local public schools and in charter schools. The Florida Comprehensive Assessment 
Tests (FCAT) includes all of these examinations. The FCAT is the heart of the state’s 
system of assigning single letter grades to local public and charter schools. 

Some of these assessment and accountability policies are old, but policies enacted since 
1999 have increased emphasis on annual testing, the accountability provisions applicable 
to local public schools and charter schools, and the consequences for individual teachers 
and students. Since 1999, in order to increase accountability, legislators have begun 
requiring the public education system to: 

1. Test students annually from grades 3 through 10. 

2. Classify local public schools and charter schools into five categories (the 
school grades, from A to F) based on test scores. 

3. Tie payments to local public schools and charter schools to test scores. 

4. Require county boards of education to create systems to pay local public 
school teachers bonuses based primarily on test scores. 

5. Fail and retain third-graders, based on reading test scores. 

Some of the new policies have been based on former practices, or actually 
represent an extension of older processes. Before 1999 there was some annual testing of 
students, there was a graduation test requirement, and there existed a system of 
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identification for under-performing schools. In 1995 and 1996, the Florida Board of 
Education approved a set of tests at the 4th, 5th, 8th, and 10th grades in reading, writing, 
and math. Each test had some components that demanded writing: in either the entire test 
(for Florida Writes, now called FCAT Writing), or in several test items (for reading and 
for math). These tests were to be aligned with newly developed curriculum standards, the 
Sunshine State Standards (approved in 1995). In addition, tenth-grade tests were to 
replace the High School Competency Test as the newest graduation requirement (since 
1977, a mandatory graduation test has existed). In 1996, Florida’s state government 
began using the new FCAT to identify under-performing schools, first called “critically 
low-perfonning schools.” 

In several ways, Florida’s current policies may be viewed as an intensification of 
older policies: more tests (at additional grade levels) now exist — for example, third 
graders must take exams to get into fourth grade; new categories for schools are based on 
testing; and a harder set of tests is the gateway to a regular high school diploma. 5 

Florida’s current assessment and accountability policies depart from past 
practices, however, in two important respects: money and application. 

State policy now gives out millions of dollars, contingent upon test scores. Schools can 
receive $100 every year per student who either: earns a grade of A or improves (by a 
grade) in the state’s accountability categories. State policy also requires that counties pay 
teachers bonuses based primarily on test scores. 

Currently, Florida has a public education accountability policy that does not apply 
uniformly to all parts of the public education system — a system that includes charter 
schools, voucher schools, and contract schools, as well as local public schools. The Palm 
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Beach Post published a series of articles on the financial accountability of voucher 
schools in the second half of 2003; and as a result, debate has expanded to the question of 
how accountability policies should apply to all parts of public education in Florida. 

Florida and the No Child Left Behind Act 

Florida’s state government created its extensive set of annual tests with high- 
stakes consequences several years before the passage of the federal No Child Left Behind 
Act (NCLB). The NCLB is the 2002 reauthorization of the Elementary and Secondary 
Education Act — the largest federal school-aid program — with established mandates for 
testing and accountability policies in each state. When President Bush signed the law, 
Florida’s existing policies were closer than most states to the new federal assessment and 
accountability mandates. State obligations already included testing children annually in 
math and reading in grades 3-8, testing children at least once in high school, evaluating 
and labeling schools based on perfonnance in at least math and reading, and enforcing 
some sanctions and rewards tied to statewide accountability. To Florida’s existing 
policies, NCLB added a mandate to hold schools accountable for how students meet what 
the law terms Annual Y early Progress goals in specific demographic categories (by 
race/ethnic groups and for students eligible for free and reduced lunches). 6 Under the 
law, each state must write its own assessment and accountability plan, and all plans must 
be approved by the federal Department of Education. 

Florida’s plan relies on the Florida Comprehensive Assessment Test (FCAT) 
results for the NCLB definition of Annual Yearly Progress. However, Florida’s Annual 
Yearly Progress goals for NCLB are substantially different from the school grading 
criteria, even though they both use the same test and even though they were defined by 
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the Florida Department of Education. The result has been a gap between the evaluation 
of schools by the state’s grading criteria and the evaluation according to the state’s NCLB 
criteria. Thus, in 2003, while 72 percent of Florida schools were graded A or B — 87 
percent of Florida schools failed to meet the goals that Florida had set for NCLB. 7 

Other state plans meet the No Child Left Behind mandate for annual progress in 
ways substantially different from Florida’s plan. Some states plan to mix multiple-choice 
exams with more open-ended, written exams. Maine, New Hampshire, Rhode Island, and 
Vennont have created the New England Compact to develop such tests, and their plans 
were approved by the federal government. Several states, like Nebraska, rewrote their 
own accountability provisions to dovetail with federal requirements, instead of 
overlaying a new accountability system onto the state system, as Florida has done. Maine 
incorporates locally-determined tests in the state plan. Other states, such as Texas, have 
different thresholds for the minimum number of children in a demographic group (within 

o 

a grade) for the assessments to be broken down for that group. 

Section 3: Data 

Data Sources 

The statutes, regulations, and rules that define Florida’s system of educational 
accountability are available online. Recent debates about educational accountability in 
Florida are in the public record, in newspaper accounts, and in other publications over the 
past half-decade. The state’s school grade reports since 1999 are available online, as are 
descriptions of the assessment and accountability programs. Federal policy and 
descriptions of other states’ plans for the No Child Left Behind Act are also available 
online. 9 
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Florida ’s Assessment and Accountability Policies 



and the Public Education System 

Explicit Values of Policies 

Key advocates of Florida’s current system of assessment and accountability have 
set forth a series of goals and policies. 

High Expectations for Students and Schools 

Legislators and the governor have emphasized high academic standards for 
students, and the expectation that schools will meet the academic needs of students. 10 
Florida’s legislature and policymakers have been consistent over the years: children 
should be learning, and local public schools should be held accountable for what children 
learn in school. 

Parallel Treatment of Students and Schools 

Currently, Florida law requires grading of both students and local public schools. 
In the mid-1990s, Florida began labeling certain schools “low-performing,” as some 
other states like Texas and North Carolina have done. Since 1999, Florida has used a 
letter-grade system to label schools for their performances. Each summer since 1999, the 
state has labeled local public and charter schools with a grade, from A to F. Before 2002, 
a school had to meet a set of criteria for each tested subject to qualify for an A through a 
D grade. Beginning in 2002, the state gave points to schools depending on the 
percentage of students meeting various categories, based on test scores. 

Sanctions and Rewards for Most Schools and Students 

Specific penalties and rewards are attached to the accountability system in 
Florida. Schools receiving the top grade of A are given $100 per student — to spend as 
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their staffs and advisory committees choose, within certain limits. Schools that improve 

between years (for example, between a C and a B) also receive reward money. 11 

Florida’s accountability system also creates consequences for students and teachers. For 

example, third-graders must pass the FCAT reading test to attend fourth grade, or 

teachers must compile an extensive portfolio to document the students’ reading skills. 

Students must also pass the tenth-grade FCAT exams (in all subjects) to earn a regular 

diploma. State law requires that counties create merit systems to pay bonuses to local 

12 

public school teachers based primarily on test scores. 

Monetization of Accountability 

Two provisions of Florida law are rare in American public education: giving 
monetary rewards to schools based on grades, and requiring that teachers be given 
performance bonuses based primarily on test scores. Of the two policies, only the former 
is fully implemented: few teachers apply for the performance bonuses. The legislature 
first enacted a reward program in 1997, appropriating $5.4 million in 1998. Initially the 
recognition program was based on several factors, with achievement test results used as a 
screening criterion but not as a final determinant of the award. 14 Governor Bush and the 
legislature dramatically expanded the program in 1999, and linked the rewards to the 
school grades — based on tests. When legislators drafted a budget for 2003-04, which 
would have shifted the reward funds to other programs, Bush threatened a veto because 
he was committed to the monetization of school accountability. 15 To its advocates, 
including Governor Bush, a financial reward gives a powerful incentive for school 
improvement in a way that no intangible recognition can provide. A standard argument 
in favor of monetized incentives for schools and teachers is that such incentives are 
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standard practice in private enterprise and that schools should operate more like private, 
for-profit businesses. 16 

Policy Implementation in Florida’s State Bureaucracy 

This subsection describes the implementation of Florida’s assessment and 
accountability policies since 1999, and several related issues. 

The Development of School Grading Criteria 

The formula Florida uses to label each local public and charter school an A-F 
school has changed three times since 1999. 17 It is also more complex than the (A-F) label 
implies. Since 2002, the criteria have been a system of points earned when students score 
on different levels in different subjects, separately for achievement in one year and 
improvement in a year, and separately for students whose reading scores were low the 
prior year. While the first priority is to give separate points for different categories, the 
administrative rules implementing the law allow mixing of categories. For example, the 
following passage explicates a way in which a school could earn points towards its 
cumulative grade in 2002 and 2003 (the first years that grades were decided by points and 
not by meeting criteria in different categories): The percentage of students who had been 
listed as being in the lowest quartile of reading scores the prior year, and who had 
improved one achievement level between the prior year and that year; students who had 
remained in the same achievement levels, as long as they were levels 3, 4, or 5; or 
students who had stayed in the same achievement level for both years, but who had met a 
certain cutoff score within the achievement level in the second spring, so as to qualify as 
having shown sufficient improvement over one year. If the school did not have 30 
students in the lowest quartile (for the percentage of those students’ scores to count), the 
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state counted instead the percentage of all students whose scores had improved an 

achievement level or who had stayed at the same level but had met the “annual learning 

1 8 

gains” criterion to count as having improved. 

Test Security and Non-release of Individual Items 

Florida statutes provide confidentiality for test items. Because Florida does not 
create enough test questions each year to release to the public, the state keeps exam items 
secret even when student access to education or a diploma is jeopardized as a result of 
performance on exams. 19 (Many states have similar policies to the one laid out above, but 
some other states with high-stakes tests, like New York and Texas, release items after the 
test. - ) As a result, parents and students cannot check to see if inaccurate test results are 
barriers to grade promotion or to a standard diploma. This secrecy rule has led to 
lawsuits by parents seeking access to student test results. These lawsuits have failed thus 
far, and the state Supreme Court has not yet ruled on the issue. In addition to questions 
about individual parental rights, the No Child Left Behind Act requires the release of test 
items where practicable."" 

Multiple Uses of One Assessment Mechanism 

Currently, FCAT is a series of tests (given in one day in February and over two 
weeks in March) that is supposed to fulfill the following functions simultaneously: 
measure individual student performance in an unbiased manner, compare the state’s 
academic performance to the perfonnance of other children around the country, provide 
information for third-grade retention decisions, be a gatekeeper for the standard high 
school diploma. In addition the FCAT decides whether: parents can send their children 
to other public schools in the same county, families enrolling their children in Title I 
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funds can use Title I dollars for private tutoring, parents can send their children to 
voucher schools, the state will give the school $100 per student, teachers will be eligible 
for merit-pay bonuses. The FCAT, due to the broad publicity of test results, also carries 
the popular functions of letting the public judge the performance of schools and, 
indirectly, of influencing the values of property in neighborhoods. 

In its original design, few expectations were placed on the FCAT. Florida’s 
current testing system, as originally designed (between 1994 and 1996), was a mix of 
multiple-choice and open-ended items used to track student achievement in a moderate- 
stakes environment. The set of tests designed a decade ago was a limited probe of skills 
at key grades, mixing multiple choice items with questions that required written answers. 
Accountability Differences in Florida’s K-12 Public Education System 

This subsection describes the range of school accountability provisions applied to 
different schools receiving direct or indirect aid from the state. All of the following 
paragraphs describe variations from the accountability provisions as applied to local 
public schools. 

Financial Controls 

Florida does not hold voucher schools accountable for fiscal management. The 
December, 2003, audit by the state’s Chief Financial Officer reports that four programs 
had been created without requiring that the voucher recipients manage money 
appropriately, or keep track of enrolled students properly. The document explained that 
the Florida Department of Education had failed to establish mechanisms to avoid fraud in 
the programs. - In January 2004, the Education Commissioner acknowledged that the 
Department of Education broke the legislature’s prohibition against allowing 
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kindergarten and first-graders into the state’s virtual-school voucher program, a violation 
of the law that cost the state $1.1 million. 24 
Student Achievement and Voucher Schools 

Three of the state’s voucher programs are not held responsible for student 
performance. Children who participate in the K-8 virtual-school voucher program will 
be taking the FCAT in early 2004. Children who attend voucher schools in the 
Opportunity Scholarship Program are supposed to take the FCAT for applicable grades, 
but there has been no statewide evaluation of those scores until recently. Children who 
attend voucher schools through the McKay Scholarship Program for students with 
disabilities, and the corporate tax-credit voucher program, have no obligation to 

25 

participate in the state’s testing program." 

Student Achievement and Charter Schools 

Florida does not make the renewal of charter school contracts dependent on 
student performance. A number of charter schools receive low grades in the state system 
without threats to their contracts, including at least eight that received F’s in 2003 but 
continue to operate, and are not subject to the same state sanctions as local public 
schools labeled F. Suspension or cancellation of charter school contracts, based on poor 
performance on the FCAT, is not required by the state of Florida and is rare." More 
fundamentally, many charter schools do not receive letter grades because of their size or 

the grade configuration. In 2002, 135 of 173 charter schools received no letter grade 

28 

from the state. 
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Evaluation of Voucher and Charter Programs 

Florida’s Department of Education conducts little evaluation of charter schools’ 
policies or state voucher programs, essentially the largest experiment in educational 
privatization in United States history. Because the state holds individual student records 
(including test scores) as confidential information, only the state (or researchers under 
contract with the state) can evaluate how individual students are performing in the 
voucher programs. Only one evaluation has been conducted of voucher programs in the 
state thus far, and findings were not widely disseminated until they were first reported in 
the Miami Herald . 29 
Ethical Standards 

Florida has an ethical code of conduct for teachers, a code that safeguards the 
treatment of students. For example, local public and charter school teachers who engage 
in unprofessional conduct may have their licenses revoked. The code does not extend to 
voucher schools, however, which can legally hire unlicensed teachers, including those 

30 

who have had their licenses revoked by the state. 

Special Education 

Florida does not require that voucher schools provide an appropriate education for 
students with disabilities. The state operates a voucher program for students with 
disabilities, but it has few safeguards to make sure that family rights are protected, that an 
appropriate education is provided, or that the state meets all the federal requirements 
(necessary for such schools to continue receiving federal funding for the purposes of 
special education). 
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The state allows families to move children to private schools with state funding, 
but it doesn’t require that the voucher schools provide individualized education plans, 
collaborative planning with families, transition plans for adolescent students, or a whole 
range of other services. All of these rights are guaranteed to public school students with 
disabilities. As reported in late 2003 by the Palm Beach Post, 77 percent of voucher 
schools educating students with disabilities do not have special services that federal law 
requires for students in special-education programs, and many have no teachers with 
specialized training. As of January 2004, there were no test cases of special-education 

3 1 

rights in voucher schools. 

To hold states accountable for the achievement of students with disabilities and to 
ensure special education services go only to students who need them, federal mandates 
require that Florida include students with disabilities in state assessments and reassess 
students receiving federal special-education services every three years. At the moment, 
Florida does not enforce these requirements for students with disabilities in voucher 
schools. As yet, there have been no financial consequences in the state for the lack of 

T9 

participation in assessments or triennial reevaluations. 

Information about Contract Schools Used for Special Education 

Florida does not provide any infonnation about contract schools used for a very 
small number of students with disabilities. Counties have the right to contract special- 
education services with outside agencies. In most cases, these are itinerant service 
providers such as physical therapists. In rare cases, counties contract with a private 
special-education school for a child’s entire educational program. This is a longstanding 
prerogative of counties in consultation with families. Yet there is no public 
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accountability for these outside providers. As with the McKay Scholarship special- 
education voucher schools, contract schools are using public funds to provide education 
without public accountability. 

Quality of Available Data 

The most reliable sources of information on accountability policies in Florida and 
in the country are the statutes, regulations, and rules — the explicit structures of the 
policies. The implementation of Florida’s accountability policies is clearest in one 
respect: the letter grades given to each local public and charter school are public 
information. The audit of voucher programs released in December, 2003, is the work of a 
professional staff conducted under the state’s Chief Financial Officer, who is in the same 
party as Florida’s governor and its legislative majorities. The series of articles by the 
Palm Beach Post is based substantially on public records that the Post requested and 
received from the state Department of Education. Because the state does not collect or 
publish information on student achievement and accountability in voucher schools or in 
contract schools, the quality of such information is questionable. 

Section 4: Findings 

Florida’s written assessment and accountability policies display both benefits and 
areas of concern. 

Benefits of Florida ’s Assessment and Accountability System 

1. Florida policy sets positive expectations for children. Florida’s official 
assessment and accountability policies affirm children’s rights to a high- 
quality education. This emphasis clearly meets the spirit of Florida’s 
constitutional mandate for high-quality education. 

9.16 




2. Florida’s accountability policy is an extension of adult experiences in 
education. Florida’s official assessment and accountability policies dovetail 
with the experiences of most adults in the state. The vast majority of Florida’s 
adults attended American schools; parents are likely to find that the state’s 
assessment and accountability practices make sense as they are familiar with 
testing and grading. 34 

3. Florida had a practical testing program before 1999. As developed in the mid- 
1990s, the FCAT was a limited set of tests that combined multiple-choice 
items with open-response questions that required that students explain their 
reasoning in different subjects. The original FCAT program, with moderate 
stakes, was a reasonably reliable guide to student achievement over multiple 
years. 

Areas of Concern in Florida ’s Assessment and Accountability Systems 
1. Florida does not hold all publicly-aided schools to the same standards. Under 
Florida’s constitution, schools given financial aid are part of the free public 
education system — therefore, the existence of different rules for different 
types of schools contradicts basic assumptions. The most discussed double 
standards are in fiscal management accountability and student achievement. 
Furthermore, there are multiple gaps between accountability for local public 
schools and accountability for other schools that provide public education. 
Such gaps do not appear to reflect the state’s constitutional requirement to 
provide a uniform free public education system, if “uniform” means that we 
hold the same expectations for all schools given public dollars. 
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2. Florida has frequently changing, and obscure, accountability rules. The 
standards for grading Florida’s local public and charter schools have changed 
(in the majority of years since 1999) and are not clear or easily understandable 
to either educators or to the general public. Changing criteria can lead to 
spurious changes in the letter grades, regardless of a rise or fall in student 
achievement. In addition to its changing nature, the formula for grading local 
public and charter schools in any single year has been a complex scheme that 
few understand. The complexity of the rules has undennined the credibility of 
the accountability system with educators, who see constantly moving targets 
rather than clear goals. While the end result is something simple — a single 
letter grade — the complexity of the actual grading criteria makes it difficult to 
evaluate the effectiveness of a school fairly, based on the grade. 

3. Florida relies on one set of measures for all accountability consequences. 
Florida’s accountability system relies on a snapshot of student performance 
for multiple purposes. Florida’s state leaders have relied on a business 
metaphor to justify monetary incentives for test score results. The current 
system provides money based on student perfonnance over a week of testing. 
Basing bonuses on a snapshot of one day or one week is not a standard 
business practice, however. Annual reports by corporations cover revenues, 
costs, and other financial data over a year, not the last week of the year. High- 
stakes decisions in business are rarely made on data from a compressed period 
such as a week. Assigning financial consequences to FCAT results alone is 
not consistent with such business principles. 
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4. Florida keeps test items secret after the end of testing each year. Test security 
is a crucial feature of any test system. However, test security needs to be 
balanced against the need for transparency so that the public can ensure that 
tests, especially those carrying high stakes, are accurately scored and that they 
validly measure what they purport to measure. Keeping test items secret after 
each year’s testing allows the items to be recycled for future years, but it 
prevents the use of items in public debate. 

Section 5: Recommendations 

1 . Create a uniform system of accountability that allows the accurate assessment 
of, and comparison among, all schools receiving direct or indirect financial 
aid from the state. 

2. Redesign Florida’s accountability regime so that the FCAT and other test 
results are used in a professionally-validated manner as described in the 
Standards for Educational and Psychological Testing, published jointly by the 
American Educational Research Association, the American Psychological 
Association, and the National Council on Measurement in Education. 

3. Release for public review (and comment) the test items on the FCAT test each 
year. 
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